Shell fitting space for classification

In this paper, a shell fitting space (SFS) is presented to map non-linearly separable data to linearly separable ones. A linear or quadratic transformation maps data into a new space for better classification, if the transformation method is properly guessed. This new SFS space can be of high or low dimensionality, and the number of dimensions is generally low and it is equal to the number of classes. The SFS method is based on fitting a hyper-plane or shell to the learning data or enclosing them into a hyper-surface. In the proposed method, the hyper-planes, curves, or cortex become the axis of the new space. In the new space a linear support vector machine (SVM) multi-class classifier is applied to classify the learn data. Classification is an important research area with a wide range of applications. Nonlinear discriminant functions (NDF) are useful in training a system to recognize specific patterns and now many applications are based on this method. Neural network and support vector machine are preeminent mathematical tools of NDF. Support vector machines (Vapnik, 1995) are very popular and powerful in learning systems because of the utilization of kernel machine in linearization, providing good generalization properties, their ability to classify input patterns with minimized structural misclassification risk and finding acceptable separating hyper-plane between two classes in the feature space. The result of applying kernels allows the algorithm to fit the maximum-margin hyper-plane in the transformed feature space. The transformation may be non-linear and the transformed space may be high dimensional; thus though the classifier is a hyper-plane in the high-dimensional feature space it may be non-linear in the original input space. If the used kernel is a Gaussian radial basis function, the corresponding feature space is a Hilbert space of infinite dimension. Maximum margin clas-sifiers are well regularized, so the infinite dimension does not spoil the results. map input space into a high dimensional feature (HDF) space that may be helpful in linearization. As we know some kernels were proposed for this purpose, namely polynomi-als, Gaussians, and splines (Friedman, 1991), but these kernels do not guaranty linearization in HDF. This problem motivates us for presentation of new space in which patterns can be classified by linear classifier, we name it shell fitting space (SFS) because we use the concept of shell fitting for the creation of the new space. is a particular instance of KMs. But it has some …